2 links tagged with all of: benchmarks + recursive self improvement
Click any tag below to further narrow down your results
Links
@TomasMann1878 on X
A Meta research engineer describes a year working on recursive self-improvement, where AI agents help train the next generation of models. The post doubles as a practical guide to breaking into AI research, covering the skills, projects, and judgment the author thinks matter.
- Recursive self-improvement can work two ways: updating the foundation model itself, or improving the prompts, tools, memory, and code around it.
- Research engineering is roughly 90% coding and 10% idea generation, testing, and repeating until something works.
- Benchmarks can mislead, so read the methodology and inspect agent traces alongside leaderboard scores before trusting a result.
- A good starting project is a small agent harness on one task: run a baseline, change one thing, inspect traces, and write up what failed.
@RayanKrishnan on X
Rayan Krishnan, writing from Vals AI, argues that human intelligence is a late, accidental product of evolution, and that AI progress shows intelligence can be built quickly once someone defines the target clearly. The real remaining human job, he says, is choosing which objectives are worth optimizing, since a slightly wrong definition produces capable but undesirable systems.
- Homo sapiens have existed for about 300,000 years, against life's 3.7 billion, so human intelligence arrived "almost yesterday" and was never optimized for maximum intelligence.
- DeepMind's AlphaGo surpassed the best human Go player within months once Go performance became an explicit target, showing that clearly specified tasks fall fast.
- Benchmarks carry a worldview: a narrow test or a wrong reward can make a model excellent in the wrong direction, so the person defining the evaluation shapes what gets built.